Web Survey Bibliography
Questionnaire development and testing for traditional paper and pencil questionnaires have tended to focus on the key elements of question type selection, wording, and order. Where self-administration is used, graphic design is also important. The transition to computer-assisted methods has added a new set of concerns, namely technical correctness (e.g., branching, calculations, text fills, etc.) and, more recently, usability.
The advent of web-based interviewing has further complicated the questionnaire development and testing phases of survey design and implementation. We now face new concerns about web-based communication styles, unique question types and formats, screen layout and use of color, added complexity to tests of technical correctness, and technical performance (e.g., speed of page delivery, appearance under different browsers, etc.).
This paper describes a series of testing protocols for Web questionnaires. It conceives of a Web questionnaire as having six main components: presentation, instructions and questions, logic and functionality, respondent environment, application software, and hosting platform. Effective testing requires that each of these components be evaluated and tested individually, as well as a thorough test of the assembled whole. The type of testing done and its point in the lifecycle of survey design and implementation will vary by component. In developing these protocols the authors draw on the survey methods literature, the literature on software testing, and their own experience both testing computer-based questionnaires and deploying hundreds of Web surveys.
Homepage - conference (abstract)
Web survey bibliography - Baker, R. P. (11)
- Survey Gamification: Old Wine in New Bottles?; 2011; Baker, R. P.
- Choosing Between Telephone and Online for Survey Data Collection ; 2010; Baker, R. P.
- AAPOR Report on Online Panels; 2010; P., Blumberg, S. J., Brick, J. M., Rivers, D. et. al.Baker, R. P.
- Don't know and no opinion responses in Web surveys; 2009; Mechling, J., Baker, R. P., Couper, M. P.
- Does Including Cell-Only Households in an RDD Survey Change the Estimates? The Case of the American...; 2008; Bryant, B. E., Baker, R. P.
- Adding Value to Data Through Improved Access. The Case for Web Portals; 2005; Baker, R. P.
- Developmnent and testing of web questionnaires; 2004; Baker, R. P., Crawford, S. D., Swinehart, J.
- Use and non-use of clarification features in web surveys; 2003; Tourangeau, R., P., Couper, M. P., Conrad, F. G., Baker, R. P.
- Testing Web Questionnaires; 2002; Crawford, S. D., Baker, R. P.
- Computer-assisted Personal Interviewing: An Experimental Evaluation of Data Quality and Cost; 1995; Baker, R. P., Bradburn, N. M., Johnson, R. A.
- New Technology in Survey Research: Computer-Assisted Personal Interviewing (CAPI); 1992; Baker, R. P.